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METHOD AND APPARATUS OF HIGH example, when using a charge-coupled device (CCD) 

DYNAMIC RANGE IMAGE SENSOR WITH system, a sin^e integration period for the entire sensor is 

INDIVIDUAL PIXEL RESET normally required. This means that either a bright star is 

properly exposed, and a dim star is lost in the noise; or, the 

This application claims the benefits of the U.S. Provi- 5 dim star is properly exposed, but the bright star is saturated 

sional Application No. 60/006,263, filed on Nov, 7, 1995. and useless for centroiding. 

Attempts have been made to implement local exposure 

ORIGIN OF THE INVENTION control in active pixel sensors. However, these solutions 

„ . . , 1 J . . J • r have generally resulted in reduced fill -factor, which is not 

Ine mvention described herem was made m the perior- m • ^ ^ i* t-h r * • *• r 

^ " .t_ appropnate to many applications. Fill-factor is the ratio of 

mance of work under a NASA contract, and IS subject to the . ^ * - • * i- l* j- -j j u .l * . i 

rruuT 1 n£ /oc TT c -.no\ • u- u the pixcl area that IS respoosive to hght, divided by the total 

provisions of Public Law 96-517 (35 U.S. C. 202), in which c ,u • i a i «ii r * mi u- j j 

. i_ I.J. . • area of the pixel. A low fill- factor will result in reduced 

the contractor has elected to retam tiue. ... j. ■ i i 

resolution ana/or excessively large arrays. 

FIELD OF THE INVENTION present inventors have recognized that local exposure 

control would be desirable since it would permit a different 

The present invention defines an improved active pixel integration period for different areas of the sensor. In star- 
sensor. More specifically, the present invention defines an tracker applicatioDS a different integration period for each 
active pixel sensor having individual pixel reset to permit star would make it possible to sense both bright and dim 
regional electronic shuttering and a high dynamic range. stars at the same time. 

While the above has described use with stars, it should be 

BACKGROUND AND SUMMARY OF THE understood that any variable image could similarly be 

INVENTION imaged. According to one aspect of the invention, each 

^ . ^ .... individual pixel can be reset in an active pixel sensor (APS) 

There are many applications for active p«el image j^^, ^ accompUshed using two reset transistors 

sensors, including scientific, as weU as commercial and 25 r ^^^^^ ^ ^. j^^^^,^^ ^ ^ ^ 

consumer apphcatioi^. Active pixel seiisots, for example, as transistors are coupled to column 

descnbed m U S Pat. No 5,471,515^tegrate the readout ^^^^^ ^^^^ 

sensor aspart of the pixel electronics. Tlie speoal techniques ^^^^^ ^^^^ ^^^^j^^ individual 

of active pixel sensing dlow using a semiconductor famdy ^^^^^j ^^^^ consequendy the integration time, 

1?kTc°J?^?™"? ^t^, CMOS, e.g.. 30 ^^^^ ^ Additional row and column controls are 

NMOS. ms ecbmque enables the readout electronic to be ^^^^^^ ^^^j^^^ individual pixel reset onto the image 

mtegrated on the wafer usmg a simUar process.pe result is ^^^^^ j„ ^^^^^ ^ conventional row-read control, a 

a highperfomiance sensor with high quantum efSciency and ^^^^^ ^ ^^^^.^^ Likewise, a column reset 

ow ar curren . control unit is added to the convention^ column-readout 

One example of an apphcation for active pixel sensors is control. The column and row-reset controls in the invention 
in guidance systems in spacecraft. These guidance systems are used to activate the column reset APS's individually, 
determine spacecraft attitude by matching an observed star- xhe invention is a significant improvement over prior 
field to a star-catalog. These celestial star-tracker systems individual pixel reset APS designs. For example, some of 
should be small in mass and power consumption, be radia- ^ ^^^^ ^^3^^ ^ second transistor in series with the 
tion hard, have a high fill factor, and high sampUng resolu- row-reset transistor, activated by a vertical column-reset 
tion. Since a star-tracker centroids an intentionally blurred ^^^^^ jesign may introduce reset anomalies when 
star image, the effect of pixel geometry on the centroiding ^sed in CMOS readout circuits for infrared focal-plane- 
algorithm should be minimal. An active pixel sensor-based arrays. It is beUeved this is due to charge pumping from the 
system can reduce mass and power consumption and radia- ^^^^^^ ^^^^ ^^set drain. An object of the present 
tion affects compared to a CCD-based system. invention is to overcome these disadvantages and to provide 

Spacecraft star-tracker systems may be required to image an active pixel sensor with individual pixel reset which 

sections whose images vary by 10^ ratio relative to one allows control over the integration time of each pixel 

another, e.g. the difference in brightness between the bright- individually. 

ness of a nearby planet and the brightest stars. As result, the The individual pixel reset (IPR) APS of the invention can 

dynamic range of these devices becomes a crucial issue. t>e used to achieve a very wide dynamic range. Dynamic 

Prior suggested solutions for widening the dynamic range of range can be modified by changing the integration time, 

active pixel sensors fall into three basic categories: com- which is the time that the pixel is exposed to incoming light, 

pressing the response curve, clipping the response, and Integration time begins with a reset signal and ends with a 
control over integration time. The first two methods result in 55 sample signal. In prior APSs having global control, pixels 

loss of some kind of detail in the image. This has led the are all reset and sampled at the same time. The present 

inventors to consider the third — this can be done either invention determines the reset time for each pixel individu- 

externaily or intemaUy. ally. This allows each pixel to have a different integration. 

External control over integration time is generally Reset is commenced by simultaneously activating both 
preferred, and can be done either globally or locally. Global 60 column and row reset coutrol hnes for a particular pixel at 

control over integration time has been achieved via elec- the same time. Sampling is accomplished at the same time 

tronic or mechanical shuttering, as well as by other means. for all the pixels. Thus, the time between reset and sample 

The inventors foimd, however, that global control does not for each pixel will vary as desired simply by varying the 

work well when viev^ng a scene that itself includes a wide reset time for each pixel. 

dynamic range. This is because part of the sensor might be 65 The invention adds only a single additional transistor in 

saturated or exposed below its minimum threshold, resulting each pixel as compared to previous (APS) designs. Because 

respectively, in white or black patches in the picture. For of this, the effect on fill-factor is minimal. This is in contrast 
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to previously reportedAPS designs that require circuitry that FIG. 3 shows the individual pixel reset (IPR) APS 46 

results in large reduction in fill-factor to achieve local pixel circuitry of the invention. It includes a photodiode 

exposure control. sensor 54, row selection transistor 56, a row^ reset transistor 

In accordance with the invention, different~ int'eRfatipD 48 and readout source-follower circuitry 58, which is 

(GmesIcSIbe^se Tacc^^ 5 coupled to the column bus 60. Logical reset transistor 50 has 

(lighirTOOllo>J^3^lA^ its gate coupled to the row reset transistor 48. In this design 

dynaSi^rSgOtp^ both the column reset line 52 and row reset transistor 48 

c|al5ime.and.adjiistingTB^ ™"St be at a logical high voltage to activate the logical reset 

(?a>S^ca5raccommFdSe Hg^^ spatially,? transistor 50, which in turn resets the APS 46. 

^s-well-as.temporally,-overi-wide dynamic-range. Also,-the^ 10 This relatively simple configuration allows low noise, 

minimum "iate gfatibn~time~can~bc" varied^acafrdin^^ anomaly-free readout. It permits the implementation of a 

iljuminancelleyeroQ^ smaller pixel with higher fill factor compared to previous 

mumrintegratioOi^3sr^constant.in„CCD pixels with local exposure control. It should be noted that 

(^onalTVPSsrThis'enables viewing^detgllliQl non-destructive readout of the pixel can be performed at any 

t ibn arcas « th^t '^OTird" 6ttili^se~ger^lost3^iggrpriot 15 time during the integration period by activating the row 

compression^like solutions torw ia^^ select transistor 56 and reading the voltage on the column 

bus 60. Nondestructive readout can also be used to deter- 

BRIEF DESCRIPTION OF THE DRAWINGS ^^^^ ,^p„,^ p,ri„d fo, , gi^,„ ^^^^ „f 

AU of these aspects and others will be described with interest, 

reference to the accompanying drawings, wherein: operation, when both the row reset 48 and the column 

FIG. 1 shows a photogate type active pixel sensor (APS) reset line 52 are simultaneously active, then the logical reset 

pixel circuit in accordance with the prior art; transistor 50 will turn on and the pixel will be reset. 

FIG. 2 shows a photodiode-type APS pixel circuitry in Otherwise, the row reset transistor 48 passes a low voltage 

accordance with the prior art; which does not further activate the logical reset transistor SO. 

FIG. 3 shows an APS pixel with individual pixel reset ^ Thus, when the APS 46 receives coinciding column reset 

circuitry in accordance with the invention; and row reset signals, the logical reset 50 is activated and the 

FIG. 4 shows the basic chip architecture of the invention; ^PS is reset. The timing of the coincidence between the row 

, , - J- r .1- T J * reset and column reset signals determmes the modified 

FIG. 5 shows a timmg diagram of the sample and reset . . • * o- j- • * . «u 

, . . . J • • A •♦u mtecration pomt. Smce the endmg point slays the same, a 

operation to achieve high dynamic range in accordance with 30 . / ^. . i *• • /u 

V - ^ & J & variable mtegration time is achieved by properly tmamg the 

the invention: , . . p^*, i • i ♦ «a 

* ^ ^ . . , ... begmmng of the logical reset 50. 

FIG. 6 shows a photograph of a fabricated test chip m „^ . , * r n — ota — n 

J -.u • FIG. 5 shows thatcfollowmg„a.reset (RST),^all previous^ 

accordance with the mvention; , — c- _ _ .\, - — -i-^jf^r^~^ 

<diarge from a~previous integration period„is_emptiea,irom:> 

FIG. 7 shows sensor output in which part of the picture the"pixel:^™s begins when Oie total available integration 

has a short integration time in accordance with the mven- ^^-j^^ ^^^^^ (SMPL) shows a previous sample 

which is followed by a reset pulse (RST). ^AtlaTpredeterr 

FIG. 8 shows sensor output for a long integration time in mineciltimerfor^any. .0ven pixej^when the^ and row 

accordance with the invention; xesetTsipals]roinciden^^^ 

FIG. 9 shows sensor output as a function of integration ^ (On^and'the integration^time^will begin^The total available 

time for various exposure settings of the invention; and integration'tim^T'encls witlTthenext sample pulse (SMPL). 

FIG. 10 shows the linearity of exposure control in accor- At this time the charge is received on the column bus and 

dance with the invention. read by the readout circuitry, as described below. Three 

examples of three different integration times are shown in 

DESCRIPTION OF THE PREFERRED g ^^^^^^^ ^2 and T3. It will be appreciated that the 

EMBODIMENTS integration time can be set for any pixel individually, to 

A presently preferred embodiment of the active pixel begin any time within in the region T of total available 

sensor with regional electronic shuttering is set forth herein integration time. 

with reference to the accompanying drawings. FIG. 1 shows The chip architecture of the invention is shown in FIG. 4. 

a conventional photogate type APS pixel. This pixel cir- 50 The APS pixel 62 includes a conventional pixel sensor array 

cuitry 10 includes a photogate type detector 12, a single reset 64; conventional row read control 66 with decoder 68; and 

transistor 14, readout source follower circuitry 16, a transfer conventional column readout control 70 with a conventional 

gate 18 and a row selection transistor 20. decoder input 72. In general, these elements operate in a 

FIG. 2 shows a photodiode type APS circuitry 22. It also conventional manner to readout information. That is, a 

includes row select transistor 24 and reset transistor 26; but 55 signal sent to the decoder 68 direct the row read control to 

uses a photodiode 28 as the light receives element instead of select a row. Likewise, a signal sent to the decoder 72 

a photogate. activates the decoder to direct the column readout control to 

Both the prior art pixels shown in FIGS. 1 and 2 connect select a sequence of columns. For each row selected, the 

all the reset transistor gates in a given row in parallel. As a column readout control will sequentially read out each pixel 

result, the entire row is reset when the reset line is activated. 60 value in the row from left to right. This output will comprise 

The integration period is the time from the pixel reset to the a differential signal which is outpjy_onJhe3rnpie_(V^„^)J74 

pixel readout Individual pixel reset is required for pixels on and reset (V^^) 76 outputs. iVbltag^V^ j^-76 is the^volt^ 

the same row to have different integration periods. This is levg^ing re sist, and"V ^ ;S~74 is thejvoi;tage^leyelAt-.th;e7 

not possible with these prior designs. Conventional circuitry gEmpjeUme. These outputs are directed to a processor 78. 

at the bottom of the column (e.g. load transistor, sample and 65 In accordance with this embodiment of the invention, in 

hold circuitry) is not shown for simplicity and arc weU order to effect independent reset and readout per pixel, 

known in the art. additional sets of row and column controls are used. The 
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column reset control 80 and row reset control 82 receive but with the same scene illuminance. The output as a 

commands from the decoders 84 and 86, respectively, which function of integration time is shown in FIG. 9. The slopes 

interpret incoming control signals. For example, for a given of these curves are plotted as a function of exposure setting 

pixel, the column reset 80 activates the column reset Hue 52, in FIG, 10. This shows that the linearity of the electronic 
shown in the APS pixel 46 in FIG. 4. Likewise the row reset 5 shutter of the invention is quite good. Unexpectedly, a 

control activates the row reset transistor 48 in the APS pixel greater response was obtained from pixels with smaller 

46. designed fill factor. 

(WheOiCrowIand_coliimn^re^OigSb It should be noted that the techniques of the invention can 

Clogicai reset 50^isT aivated^dlhrinte Erati^jime"j^ be applied to photodiode-type APS pixels, as well as 
This integration time will terminate at the time of the'sarnple lo phologate-lype APS pixels. The excellent hnearity of the 
signal, as shown jn FIG. 5/ IntHis way/the^lumn~andTesetp electronic shutter operation will also permit the use of the 

contfols~80782"permit independently resetting any pixel architecture in detector arrays for non-imaging applications, 
address within the array, without interfering with the readouj :^ such as spectroscopy, where very large dynamic range 

p roces s. ^ ^ ~~ — between nearby channels must be accommodated. 

Referring again to HGS. 4 and 5, fi nitiall >v the pixellg ay Although only a few embodiments have been described in 

(6"42wifiTsense~tHerilliimSaIim^ The detail above, those having ordinary skill in the art will 

voltage is then passed for readout during the sampling time. certainly understand that many modifications are possible in 

(^signairfRST^IstaBs^^MSigf^^ the preferred embodiment without departing from the teach- 

p^reffi^ingTSETiensoE^otherX^ ings thereof. 

the^g d^bf the~inte lratibD,timelT<f In response to the sample All such modifications are intended to be encompassed 

signal, the voltage passes to the readout circuit. within the following claims. 

In most prior APS designs, all of the pixels have a fixed What is claimed is: 

integration time of T. Consequently, if the illumination is 1. An imagmg device comprising: 

high, the sensors might get saturated and no meaningful an array of pixel cells, arranged in columns and rows, 

information will be passed on. Conversely, if the illumina- ^ each pixel cell comprising a photo-sensitive element 

tion is low and the integration time is not appropriate, the capable of generating an output indicative of incoming 

output voltage is too low. Thus, only a limited range of electromagnetic radiation, a logical reset transistor hav- 

intensities can be correctly recovered with such sensors. If ing a source coupled to control said photo-sensitive 

a second reset is given to a pixel by means of the logical element and a drain biased at a potential, a row reset 

reset 50 (LRST) before the end of the regular integration transistor having a gate to receive a row reset signal, a 

period, a shorter effective integration time is achieved. drain to receive a column reset signal, and a source 

/pGTr5-showOHre 0^xamples"Tif "three~inte^ coimected to a gate of said logical reset transistor to 

rT47 T2'and'T3 7Pfo^ssorJ78,'!liaving rec eived't EelsignalTfbr reset said photo -sensitive element when both said row 

^a^p^r^miiignals-74.aiidJ6,,wiirb^^ and column reset signals are high; 

fintensit 5r at~r^\^~pixel~ an d~mod i^^^^^ a control circuit coupled to control said array; 

accordingly.~Qm :e the' ^g^e^^^ a row reset control element coupled between the control 

this^info rmarion^is^sent^ column an d^ circuit and each pixel cell in said anay to produce said 

rowjgset"cQntrOls^8Q r82'to c onSortHe~Lnteg ration~tim ^fo^ reset signal; and 

that' pixel^^n djubsequent g^out^ This allows the processor ^ ^ column reset control element coupled between said 

to keep each pixel within a desired dynamic range. control circuit and each pixel cell in said array to 

Not only is the integration time ad justable for each g iven produce said column reset signal, wherein said row and 

pixeljnde penden tly, but a/dynamic modification in the\ column reset control elements are operable to randomly 

integration time for each pixel can be made in reaU dmeJn^ reset any pixel cell independently, 

^ respo ngejgjh^instaneousjnten^^ course, the actual 2. An imaging device as in claim 1 wherein each of the 

intensity will be calculated as a function of the variable row and column reset control elements includes a decoder to 

integration time and the magnitude of the measured signal. decode a respective control signal from said control circuit. 

A monolithic semiconductor APS test chip in accordance 3. An imaging device as in claim 1 further including a 

with the invention was implemented as an array of 64x64 readout circuit that comprises a field effect source follower 
photodiode-APS elements. 5q output transistor. 

FESjonallesting ofiM^liSfii 4, An imaging device as in claim 3, further comprising: 

circuitry "conflrmed^the j)p erah ilit y~of ~the~indi vidual^pixer a row readout control circuit coupled to each row of pixel 

rgseL^p^atiphrXQi^^)^ o perationlsollhat Jhe cells and selecting individual rows for readout; and 

outpuUiotild be readily^obseiyed^n Tm^ a column readout control circuit coupled to each column 

(Chjp"^ipmnObe entire widOTof Jhe sen sor were s elected 55 of pixel cells to select a column for output, 

foLreset, resulting m a region of less-exposed rows. 5. An imaging device as in claim 3 wherein said readout 

A pair of output images is shown in FIGS. 7 and 8. The circuit includes a reset output terminal to produce a signal 

image in FIG. 7 shows the output of sensor where the display indicative of an output level of said photo-sensitive element 

is optimized for the majority of the image. The black band during reset and a sample output terminal to produce a signal 
across the image represents pixels that were reset during the eo indicative of an output level of said photo-sensitive element 

nominal integration time, so that they had a shorter effective after completing an integration. 

integration time. When the display is optimized for these 6. An imaging device as in claim 1 further comprising a 

pixels, the image in FIG. 8 results. The other pixels in the monolithic semiconductor integrated circuit substrate on 

majority of the image appear saturated, or white. which said array of pixel cells, said control circuit, said row 

The linearity of the "electronic shutter" operation of the 65 and column reset control elements arc formed, 

invention was measured by measuring sensor output as a 7. An imaging device as in daim 1 further comprising a 

function of integration time, for various exposure settings, readout circuit coupled to said array and said control circuit. 
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wherein said control circuit is operable to modify a timing 9. A device as in daim 8, wherein said photo sensor 

of at least one of said row and column reset signals in includes a photodiode. 

response to a readout circuit output, whereby the dynamic lo. A device as in claim 8, wherein said photo sensor 

range of the imaging device is modified. includes a photogatc. 

8. An imaging device, comprising: 5 ^ ^^^j^^ ^ ^^^^^ ^^^^her comprising a readout 

a substrate; and circuit coupled to said photo sensor to receive said pixel 

an array of pixel cells formed on said substrate and output signal 

arranged in columns and rows, each pixel cell com- 12. A device as in claim U, further comprising a control 
pnsing: , in circuit coupled to said readout circuit and said array to 

' ? °SeTout' TfT' ""^"^ ^ ^ '^Snal from each of said pixel ceUs, said 

a HiZr^^T hTwng'a source coupled to said photo ^^^^^^ ^^^^ ^P^^^^^^^ ^^^^^^ ^ integration time of a 

sensor and a drain coupled to a bias potential, and P^^^ ^y controlling at least one of said row reset and 

a second transistor having a source coupled to a gate of column reset signals in response to an output signal from 

said first transistor, and a gate coupled to receive a said pixel cell. 

row reset signal, and a drain coupled to receive a 13. A device as in claim 8, wherein each of said pixel cells 

column reset signal, wherein said first transistor is on is an active pixel cell, 
to reset said photo sensor when both said column 

reset and row reset signals are high, * * * * ♦ 
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